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2a )□ This action is FINAL. 2b)^ This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 
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DETAILED ACTION 

1 . This Office Action is responsive to comnnunication filed November 3, 2008. 

2. Claims 1 -19, 25, 32, and 34 - 39 have been cancelled. 

3. Claims 20 - 24, 26 - 31 and 33 are pending in this Office Action. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 20 - 24, 26 - 31 and 33 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Non Patent Literature (NPL) "Dynamic Generation and Refinement of 
Concept Hierarchies for Knowledge Discovery in Databases by Han et al., (Hereinafter 
"Han") in view of NPL "AN environment for content-based image retrieval from large 
spatial databases by Agouris et al., (Hereinafter "Agouris"). 

Regarding claims 20 and 27, Han discloses a method for processing multimedia 
data in a computer system, comprising: 

receiving as input a high-level concept describing data to be accessed (see page 
1 66, section 5.1 , paragraph 1 : "a convenient graphics user interface is being developed for 
users to input concept hierarchies at both the schema level (e.g., address (City C Province C 
Country)) and the individual concept level"); 
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translating tlie liigli-level concept into a low-level query by using stored concept 
constructs (see page 161, example 3.1, paragraph 3: "the mapping of higher level 
concepts in the query (or learning task) to their corresponding lower level data") which are 
defined using features derived from a plurality of application domains (see page 158, 
section 2.1 , paragraph 2: "A concept hierarchy can be defined on one or a set of attribute 
domains"), wherein the stored concept constructs are each represented using a 
hierarchical fuzzy graph data tree-structure comprising nodes that correspond to child- 
concepts (see page 1 58, section 2.1 , paragraph 1 : "A concept hierarchy defines a 
sequence of mappings from a set of lower-level concepts to their higher-level correspondences. 
Such mappings may organize the set of concepts in partial order, such as in the shape of a tree 
(a hierarchy, a taxonomy), a lattice, a directed acyclic graph, etc., although they are still called 
"hierarchies" for convenience") and a subset of the features (see page 158, paragraph 
2: "a subset of data"). 

Han does explicitly disclose transferring the low-level query as claimed. 

Agouris discloses aggregation edges that correspond to parent-child 
relationships, and association edges between siblings that correspond to inter-sibling 
constraints (see Fig. 4 and page 267, column 1 : "sketch is first matched against the 
features at the parent level in the tree. The process then progresses to child, grandchild and 
other levels as necessary" - see also the hierarchical levels i.e. "the primary parent level", 
"the child level" and "grandchild level" on page 267 - 268; these parent-child and siblings 
relationships); and transferring the low-level query to one or more search engines to 
access information using the low-level query (see page 263, section 1, column 2: "low- 
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level image properties (e.g., colour and dominant pattern) are often adequate for information 
retrieval"). 

It would have been obvious to one of ordinary skill at the data processing art at 
the time of present invention to combine the cited references because Agouris' teaching 
of using the low-level properties for the search would enable Han system to solve the 
problem of content-based image retrieval using on shape and topology as suggested by 
Agouris (see Abstract). 

Regarding claims 21 and 28, Han discloses a method as defined in Claim 20, 
further comprising: 

storing the concept constructs in a concept library module (see page 166, section 
5.2: concept hierarchy base is analogous to concept library module); 

storing matching algorithms in a matching algorithm library module (see page 
1 66, section 5.2: algorithm(s) on the data stored in a database is analogous to matching 
algorithms in a matching algorithm library). 

Han does not explicitly disclose feature library as claimed. 

Agouris discloses storing the features in a feature library module (see Fig. 2); 
and storing constraints in a constraint library module (see page 270, column 2, 
paragraph 4: a temporal constraint is analogous to constraint library). 

It would have been obvious to one of ordinary skill at the data processing art at 
the time of present invention to combine the cited references because Agouris' teaching 
of feature library would enable Han system to provide the crucial link that allows us to 
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reduce the search space of a query from a large image database to an abridged group 
of features as suggested by Agouris on page 265, column 2, paragraph 2. 



Regarding claims 22 and 29, Agouris discloses a method as defined in Claim 21, 
further comprising interfacing the library modules to the application domains (see Fig. 
2). 

Regarding claims 23 and 30, Han discloses a method as defined in Claim 21, 
further comprising building a concept construct (see page 158, section 2.1, paragraphs 
1 and 2: Defining concept hierarchy is analogous to building a concept construct). 

Regarding claims 24 and 31, Agouris discloses a method as defined in Claim 23, 
wherein the step of building a concept construct comprise combining one or more of the 
features with zero or more of the stored concept and zero or more of the constraints 
(see page 268, section 5, paragraph 1). 

Regarding claims 26 and 33, Agouris discloses a method as defined in Claim 20, 
wherein the features are user defined (see page 263, "abstract": " user-provided sketches 
of the shape and spatial configuration of the object (or objects)"). 



Conclusion 
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5. Any inquiry concerning tliis comnnunication or earlier comnnunications from tlie 
examiner sliould be directed to FRED I. EHICHIOYA wliose teleplione number is 
(571)272-4034. The examiner can normally be reached on M - F 8:00 AM to 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Pierre M. Vital can be reached on 571-272-4215. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Fred I. Ehichioya/ 
Examiner, Art Unit 2169 



